DOCDHEHT BESDHB 



BD 126 071 



SP 010 258 



^ ADIHOE 
TITLE 

PDB DATS 
NOTE 



ED5S FSICE 
DESCEIPTOSS 



IDENTIEIEBS 



Clark, Richard M. 

A Micro-Study of Teacher Behavior in Outlier 
Schools. 

Apr 76 ' 

14p.; 'Paper presented at Annual Meeting of American 
Educational Research Association (San Francisco, 
California, April 19-23^T97'6) 

MF-$C*83 HC-$1.67 Plus Postage. 

Academic Achievement ; Achievement Eating ; *C3,assrooi] 
_Qbser yation Technigues; ElesL^^tary ^E^ucatj-on; Field _ 
Studies; ^Predictor Variables; *PrrDcrpals; ^Te^clier 
Behavior . 
Outlier Studies 



ABSTEACT 



predictors of 
children, yet 
or worse than 



Variables that schools can not directly control are 
a significant portion of the achievement differences of 
some schools seem to be operating significantly better 
predicted in regard to pupil achievements This 
otservation study represejrcs an effort to look more closely at 
schools in' which actual pf^il achievement was higher (high outlier) 
or lower (low curlier) than predicted. Seven instruments were 
developed for This observation study: (1) classroom observation form; 
(2) observation of a reading group form; (3) teacher reinforcement 
scale; (4) characteristics of open education form; (5) teacher 
questionnaire; (6) pr*incipal interview form; and (7) reading teacher 
form* Names of 1U principals in upstate New York were obtained — seven 
were located ar high outlier schools, seven were at lew outlier 
schools* In each case^ the principal arranged access to nine 
elementary school classrooms (k-6) . Two observers visited each V_ 
school* Each observed four different classrooms^ and the pair 
observed one classroom together. In addition^ an interview was held 
with the principal and with a reading teacher in the school. Some of 
the major ways in which low and high outlier schools differ according 
to the data are: teachers in high outlier schools were warner and 
more responsive^ showed more emphasis on cognitive developoent, wei;e 
more effective in maintaining the desired level of control in the 
classroom^ expected more children to graduate from high school, 
perceived the children as more intelligent eind more pleasant to 
teach; higher outlier schools appeared more open and principals in 
high outlier schools saw their personnel as more competent and 
themselves a^s having better rapport with teachers^ p^girents, and 
pupils. (MM) 
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Do different schools and different telphers really have a different 



effect on how children learn? This question has long been of interest 

to educational researchers. A popular answer has been that schools and 

^teachers really have very little differential effect. The great spread 

of pupil achievement is almost entirely accounted for by factors exter- 

r 

nol-to the school. Pupil achievement, or the lack of .it, is a product 

of social class, of neighborhood, of initial intelligence, or of books 

in the home. Class size, money spent by the district for education, 

level of education of the teacher and other such school related variables 

have. not been Seen to be highly relat school schievement. For 

example,* J e neks and Brown (l975), in a reanalysis of Project Talent data 

for 98 high schools, conclude 

... high school characteristics such as social composition,' 
per-pupil expenditure, teacher training, teacher expel'ience, 
ajid class size have no consistent impact on cognitive growth 
between ninth and twelfth grades. These, findings imply that 
if we want to "boost s-fhdent performance, we need drastically 
new methods. Our data tell us nothing about what methods 
might be most effective. They tell u^ only that more money, 
more graduate courses for teachers, smaller classes, socio- 
economic desegregation and other traditional remedies are 
unlikely to have much ^effect. ,(p. 320) 
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, A§ can be seen fr,oin the regression studies that were presented as 
part of this symposium, .viariables wMch schobis can not directly control 
do predict a significant portion of the achievement differences of chil- 
dren. Yet, as seen in the Outlier Studies, some schools seem to be 
doing significantly better and^ some significantly worse than predicted 
on the basis of regression prqdedures. The observation study represented 
an effort to look more closely within schocas in which pupil achievement 
vas higher or lower than predicted. 

A group of faculty and advanced graduate students in education was 
enlisted to work on the study. Starting with the original outlier forms, 
and a review of relevant literature, the group attempted to generate 
suggestions of relevant factors that migSl be observed in schools. Spe- 
cific scales and scale definitions were then developed.' 

Arrangements were made for field tryout? o^" these scales In two, 
public schools. ' In each case, four observers visited the school. Pairs . 
of observers made twenty-minute observations in six different classrooms 
SO that each observer was "paired with every other observer . Also a pair 
of observers interviewed the reading teacher and the other two observers 
interviewed the school principal. 

After the first field trials had been made, data were inspected for 
reliability, and a group meeting was held to discuss problems and proce- 
dures. In this meeting .agreement was reached that somp forms needed re- 
vision, some categories needed redefinition, and some new areas needed 

to be included* . , 

« - ■ 
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After instr-uments had been revised and constructs redefined, names 
of principals of fourteen school buildings in upstate New York were ob- 
tained, "based on analyses described earlier. Seven buildings were low 
outliers, and seven were high outlier. Observers were unaware of whetlie 
a school was ''high" or "low," 

in each school the principal arranged access to nine elementary 
school cla^ssrooms between kindergarten and sixth grade, (in a few of 
the smaller schools, nine classrooms were not available.) m observers 
visited each school. Each person observed fo\ir different classrooms, 
and the pair observed together in one classroom during the day. In ad- 
dition, an interview was held with the school principal and with a read- 
ing teacher in the school.' / 

This report includes a brief description of eacf^ of the seven in- 
struments that were develo^ped. Data from four instruments were obtained 
by classroom observation. A factor analysis of the observatioji data is 
presented and discussed. A summary of the major ways in' which high and 
low outlier schools were different is also provided. 

Generail Classroom Observation Form 

The General Classroom Observation ^brm consists of 16 items. - Ques- 
*tions are ^ouped under the area of program emphasis, teacher behavior , 
pupil behavior, and facilities. A five-point Likert scale was used, 
ODerational, definitions were developed, for each end of the scale. The 

form was 'developed specifically for this study. 

I 

Observation of a Reading Group 

The form used for observation of reading classes is a modification 
of an observation system developed and^tested by Educational Testing 



Service (Quirk, et al , 1^73; Weinberg, et^ al , 197^+). To develop the 
original instrument, member's of a research team visited second, foxirth, 
and sixth grade reading classes and kept a log of the activities that took 
place. Eventually, they arrived at twelve categories to describe what 
they called the Content of Instruction. They also developed definitions and 
examples of each area. The ETS procedure called for a -different student to 
be scored on the instrument during each fifteen second interval in an 
observation period of fifteen minutes. 

Because in this project a broader range of observational data were 
desired, it was decided to attempt to score each category of Content of 
Instruction on a Likert scale arranged from "Little'' to "Much," The 
categories "Extranegus" and/'Negative Feedback" were dropped from the scale 
since other observation devices covered' these areas. Sepeirate ratings were 
to be made of the activities of children in a reading group directed by the 
teacher and children not in the reading group. 

Thus, the fqrm used in tne first field tryouts consisted of ten 
categories to be rated for the reading group and the children not in the 
reading group. From these tryouts it was determined that one additional 
SLTea, oral reading, was needed for the reading group. A definition was 
written for this atrea. Also, observers found that the categories available 
did not allow adeq^uate descriptiion of the behavior of ahildren not in 
reading groups, and that too much inference was req^tdred tp determine 
whether a child wrijiing at his seat was working on word recognition,- • 
language structure, or spelling. Therefore, the list of items to be rated 
for the non-reading' group was revised and new definitions written. 
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Teacher Reinforcement Sc 

The Teacher Reinforc^t^aent Scale 
developed for use in this study. 



for this set of observations wes 
the review of literature it seemed 



clear that teacher reinforcement mig^t^ell be a critical variable in how 
children learn, but the problem remained of hoy to score this domain in a 
simple but meaningful way. It was agreed that one might discriminate 
betwee^ positive reinforcement in the form of praises or token reward, and 
punijbnent in the form of scolding, criticizing, withholding privileges, 
and, the like. These punishing behaviors are labeled as "negative 
r Enforcement" on the form, although they do not fit the classical 
learning definitions of negative reinforcement, 
y Along with the distinction of positive and negative, distinction was 

; made between frequency and potency. Some teachers used a great number of 
remakrs such as "good" or "correct," but they used these remarks so 
routinely that observers wondered if they woiild really have much effect. 
Other teachers did not praise as frequently, but they ejctended and 
elaborated their comments. Obviously, an observer- can 't be sure of the 
effect of either form of comment on ,a child,- but the rating of potency is 
included as a subjective measure in which the observer attempts to score the 
meaningfulness of the reinforcement given. 

Finally, it was agreed that what the tea&her reinforced was of 
interest.' In some cases teachers praise or punish the child's actual 
•product — his math paper, or^the way he reads. ^At other times teachers 
praise the child's generaJ. conduct or social behavior — the way he pays 
attention or works on an assignment. "Therefore, it was decided to attempt 
to separate ratings for instructional specific and general support/social ^ 
behavior reinforcement. 

6 
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Characteristics of Open Education 

Items from the Charac^ristics of Open Education form were derived 
from the Waiberg-Thomas (l97l) instrument. In their procedure, teacher 
interview was used as a means of supplementing classroom observation, while 
in .this study only observation was used to derive data. Since this form 
was not used in preliminary field work, no data were available to form a 
basis for revision. Observers reported that some items were not really 
suitable for observation and also indicated that clearer polar definitions 
would be useful. 

Teacher Questionnaire 

In the first planning meeting the Project team discussed the question 
of how to obtain information from teachers that could not be gained through 
observation. Clearly, it would be desirable to know about teacher ^ 
intentions, philosophy, evaluations of children, relationships with 
administration, and a host of other variables. At the same time, to b^ild 
in ,even a modest teacher interview would drastically reduce the niimber of 
teachers who could be observed during a school visit* 

The decision was finally reached to prepare a questionnaire which 
could be responded to very quickly. The areas of concern in this 
questionnaire were derived primarily from variables that appeared promising' 
in the Outlier Study. Thus, the teacher is asked about her expectancies 
for the children she teaches, her assessment of the general ability and 
attitude ftf her present class, the degree to which she would expect help 
for various problems that might be encountered, emd her assessment of the 
locus of control for decision-making, 

I 



Principal Interviev 

The Principal Interview form was developed in large ^)art from vari- 
'ables that seemed to be of interest from the original Outlier Study 
(Irvine and Heim, 1973)* *^An effort was made to obtain (l) specific 
cfemographic information about the school; (2) subjective impressions 
of the prihcipal concerning the professional staff in the school, the 
adequacy of facilities and material support for the reading program, 
the locus of control of the reading program; and (3) principal's judg- 
ment of special problems and ^special assets of the school. 

Although the form calls for precise answers to most of the questions, 
the procedure specified an informal interview approach. Thus, the per- 
son obtaining data was encouraged to engage the principal in discussion 
of the areas to be covered and to probe m specific areas until a scor- 
able answer was' obtained. Hie order of questions might be modified 
to fit the circximstances . 

Reading teacher Interview 

The interview guid^ used with the reading teacher in each school was 
adopted from an "Observer Guide-Reading" which was made available to 
the Project Director to Mrs. Jane Algozzine, Chief of j the Bureau of 
Reading, State Education Department. Originally, this observation instru- 
ment was used in direct classroom observation, supplemented by teacher 
interview, to describe the degree to which reading practices seen as 
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ideal were actually practiced* The original instrument consisted of 
13 qategories, each to be evsiluated from "low" to "high" on a five- 
point scale. Paragraphs describing "low" and "high" practices were 
' provided for each item. Also, in the original instriiment, considerable 
space was provided for comments on each room* 

In this study it vas decided to use ten of the thirteen "Observer 
tiuide-Reading" categories in an interview format with the reading 
teacher. The definitions of "low" and "high'^^^^tekacvlor ^r,, these ten 
categories were used as a guide for interviewer scoring Aspects of the 
reading program which were questioned r-elated primarily ta, reading it 
IS C8u:'ried on in »the^ classroom. Therefore, the reading person who 
seldom ^visits the classroom of talks with the teacher could not be 
expected to give valid responses to the questions 'asked. However, all 
reading teachers did indicate a general familisirity of the^ reading 
f)rogram as carried on in the classroom euid did seem to feel that they had, 
a good idea of the answers to these questions about the reading program. 

Analysis of Data <$ 

Presented in Table 1 are some of the results of a factor analysis 
of the items rated in the classroom. 



Table 1 about here 
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The 'five factors which are presented account for k3»^% of the total 
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variance. All factor loadings of more than ♦SO are indicated. As (?an 

/ 

be seen, factor one is largely defined by items on the Open Educati^i^i^ 
form. Factor two is largely defined by items on the Gpneral Classrofo. 

Observation Scale and positive reinforcement items of" the Teacher ^ 

/ 

Reinforcement Scale. A considerable amount of ovei^iap exists between 
Teacher Behavior it^ms which load on' both Factor /ne and Fafctor two. 



/ 



Factor three is defined by items on control efforts, control 
effectiveness and negative reinforcement, Fac/tor four is defined 
primarily by the. potency of reinforcement i^ems , vh^.le Factor five is 
largely defined by items on the Observatipn of Reading scale, 

A complete contrast of the quantitative differences between high 
and low outlier schools is available in the final project report (Clark, 
197^). In this paper, only the major conclusions are summarized. 

Summary of Findings Which Differentiated Schools 

1, Teachers in high outlier schools made less overt effort to 
maintain class control, had less rigid student behavior but were 
more effective in maintaining the level of control they appeared 
to want, 

2. Teachers in high outlier schools were rated as warmer, more 
responsive, and showing mor^ emphasis on cognitive development 

^ in classes that did not involve direct reading instruction as 
well as in reading classe/. 
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3. Teachers in high outlier schools e:fpected more children to graduate 
from high school, to go to .college, to "become good readers, and to 
become good ^citizens. 

U. Teachers in high outlier schools see the children they teach as more 

intelligent, better behayed, more pleasant to teach, and their 
\ parents as more conqerned. ' * . 

5. Teachers in high and low outlier schools do not see different amounts 
of administrative help available in handling problems » 

6. More total activity takes place in reading classes in high outlier 
schools than in low outlier schools. 

7. Children in reading classes in high oi^tlier schools engage in more 
salient reading, while children in low outlier schools engage in more 
oral reading. ^ 

8. ^Reading teachers in high outlier schools eveduated the reading pro- 

grm more favorably. Teachers were rated more faLvorably in using 
appropriate materiaQ., extending reading intopther ar'eas , asking chil- 
dren to rea^ with a purpose, and using informal diagnosis. 

9. In grades one to three, teachers in high outlier schools gave more 
positive .and les*s negative reinforcement than did teachers in low 
schools. - yj 

10. High outli'ei\^chools appeared more .open than low outlier schools. 

11. ' Principals in high outlier schdols generally saw their personnel as 

more competent than did principal in low outlier schools. '^'^ 

12. Principals in -nigh outlier schools saw themselves as having better 
rapport with teachers, parents, and pupils than did principals in 
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low outlier schools. Principals in low outlier schools reported 



better rapport with the school board. 



13. Items on physical space and facilities generally did not differentiate 
between high and low schools . 

Summary and Conclusion 

At the end of the study each observer was asked to submit in writing 
his impressions of each o-f the devices, problems they faced and the like. 
A limitation of this study ^ noted by ^several observers, was the fact that 
the work was carried out very near the end of the school year. Of great 
interest is the question of whether similar differences would be noted 
at the beginning of the year. Perhaps, in the area of management instruc- 
tion for example, some teachers give m\ich direction yery early in the 
year, establish a firm routine, and need to give relatively* few such di- 
rections thereafter. * Observ^^rs in this study reported more management 
instruction in-l^w than in high schools, but it would be interesting to 
note whether ^this difference is the same at the beginning of the school 
year. . 

Thus, next steps that might be taken in this area are: 

(l) Select the variables that seem to be related to the clearest 



(2) ' Attempt to clarify further the behaviors that are being rated ^ 
and^^he criteria for rating each of these variables. 



differences between schools. 




(3) 



Consider wl^ther the variables identified by these procedures 
<iolild be meaningfully divided into sub-parts to "be more speci 



fically studied. 




(1+) Try out revised 'materials on a broader geographic basis and 
^ ^ ^^y;lth schools thato Are demographic ally more diverse. 

(5) Experiment with these^^ifat erials in an in-service and/or 
pre-service context. \ ' 

(6) Work systematically with a group of teachers to see if 
teachers can learn to vary selected behaviors, and study 
the effects ^ such variation. 1 
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